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PATENT 

Attorney Docket No.: 20945-1. 10US 

A METHOD FOR CO-CHANNEL INTERFERENCE 
IDENTIFICATION AND MITIGATION 

CROSS-REFERENCES TO RELATED APPLICATIONS 
5 [01] This invention is a non-provisional application of U.S. 

Provisional Application No. 60/251,254 filed December 4, 2001, the content of which 
is incorporated herein by reference. 

STATEMENT AS TO RIGHTS TO INVENTIONS MADE UNDER 
1 0 FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT 

[02] This invention was made under partial sponsorship of U.S. Army 
CECOM under Contract No. DAA H07-98-C-J403. The U.S. Government retains 
some rights to this invention. 

1 5 REFERENCE TO A "SEQUENCE LISTING," A TABLE, OR A COMPUTER 

PROGRAM LISTING APPENDIX SUBMITTED ON A COMPACT DISK 
[03] NOT APPLICABLE 

BACKGROUND OF THE INVENTION 
20 [04] This invention relates to digital signal information demodulation 

and more particularly this invention relates to demodulation of packet-based wireless 
signals in the presence of interference from one or more of a known class of packet- 
based signals. Current narrowband Time Division Multiple Access (TDMA) cellular 
systems, such as IS-54 or GSM, are designed to accommodate several time-multiplexed 
25 users in the same RF channel, thus providing a capacity improvement over older analog 
Advanced Mobile Phone Service (AMPS) Frequency Division Multiple Access 
(FDMA) systems. This capacity is limited by frequency reuse, which is related to a 
receiver's ability to tolerate Co-Channel Interference (CCI), especially with cell 
splitting and cell reduction as in Personal Communication Service (PCS) systems. 
30 [05] Fig. 1 is a diagram of a cellular network utilizing frequency 

reuse. The figure shows a "7/21" reuse pattern, corresponding to a reuse factor of 7, 
with 120 degrees sectoring, which is know to those skilled in the art. In cells involving 



frequency reuse, the receiver must detect and receive a desired signal from an Intended 
User (IU) in spite of CCI signals that share the same RF channel. The presence of CCI 
signals may degrade the Bit Error Rate (BER) associated with reception of the desired 
signal by orders of magnitude, even when the CCI power is significantly below that of 
5 the RJ. Furthermore, multipath-induced Intersymbol Interference (ISI) in frequency 
selective fading channels constitutes another major source of degradation. Hence, CCI 
and ISI mitigation capabilities of a receiver can lead to increased capacity and better 
overall system performance. 

[06] Existing CCI mitigation techniques attempt to suppress the 

10 contribution from the interfering signals to the received waveform. One class of such 
techniques employs antenna arrays that can introduce spatial nulls in the direction of 
the CCI and enhance the IU(s). The applicability of these techniques, however, is 
constrained by the number of antenna elements. (Typically, the number of beams or 
nulls formed cannot exceed the number of elements.) Similarly, there are user/CCI 

15 geometries for which linear combining techniques necessarily fail (e.g., when an 
interferer and the IU signals lie in regions where a linear combiner has equal gain). 
Another class of CCI mitigation techniques uses traditional Decision-Feedback 
Equalizers (DFE) that exploit the cyclo-stationary nature of CCI in order to reduce its 
effect in the detection of the IU. These techniques are effective in cases when the IU 

20 and the CCI signals are separated in some dimension (e.g., space or time). However, 
they are prone to severe performance degradation when there is little or no separation. 
Furthermore, even in cases of good separation, suppression of strong CCI signals can 
still result in significant reduction of the received Signal-to-Noise Ratio (SNR) for the 
IU. 

25 [07] Joint detection techniques provide an optimal approach to data 

detection in the presence of ISI and CCI. In contrast to the traditional approaches 
described above, joint detection techniques do not attempt to null the CCI signals; they 
model and detect CCI signals along with the desired signal from the IU. Detection of 
CCI signals is introduced as a way of assisting the detection of the IU, not as a goal of 

30 its own. 

[08] One straight-forward method using joint detection techniques is 
disclosed in U.S. Patent No. 6,249,5 18B1 entitled TDMA SINGLE ANTENNA CO- 
CHANNEL INTERFERENCE CANCELLATION issued June 19, 2001 to Jian Cui 
and assigned to Nortel Networks. This patent describes an approach to cancellation of 
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co-channel interference from TDMA packet-based signals. The approach assumes a 
simplified channel model wherein the channel is assumed to be memoryless so that 
decision feedback does not need to take into account pre-existing states of the desired 
signal or of the interference. Hence, the system uses a multi-stage block decision 
5 feedback channel gain estimation algorithm and a memoryless joint detection 
algorithm. However, since the memoryless model breaks down in systems with a 
transmission bandwidth larger than the coherence bandwidth of the channel, the 
receiver fails to provide significant mitigation of co-channel interference and totally 
fails to provide any mitigation of intersymbol interference. 
10 [09] Another approach to cancellation of co-channel interference 

from TDMA packet-based signals is disclosed in U.S. Patent No. 5,995,499 entitled 
SIGNAL DETECTION IN A TDMA SYSTEM issued Nov. 30, 1999 to Hottinen et al. 
and assigned to Nokia Telecommunications Oy. 

[10] The following references selected from the paper forming the 
15 basis of the priority provisional application, namely, G. Paparisto, P. Panagiotou, and 
K. M. Chugg, "A Single Packet Method for Adaptive Maximum Likelihood CCI 
Identification and Mitigation," published Proc. of IEEE Globecom Conference, Rio de 
Janiero, Brazil, Dec. 8, 1999, represent background and the general state of the art: 

[11] J. Lin, F. Ling, and J. Proakis, "Joint data and channel estimation 
20 for TDMA mobile channels," in Proc. PIMRC '92, Oct. 1992, pp. 235-239. This paper 
describes PSP for ISI mitigation. 

[12] N. W. K. Lo, D. D. Falconer, and A. U. H. Sheikh, "Adaptive 
equalization for co-channel interference in a multipath fading environment," IEEE 
Trans. Commun., vol. 43, pp. 1441-1453, Feb./Mar./Apr. 1995. This paper describes 
25 an alternative co-channel interference mitigation algorithm. 

[13] S. Verdu, "Minimum probability of error for asynchronous 
Gaussian multiple-access channels," IEEE Trans. Inform. Theory, vol. IT-32, pp. 85- 
96, Jan. 1986. This paper is the seminal paper on joint modeling of interference. 

[14] R. A. litis, "A digital receiver for demodulation of CDMA 
30 waveforms with a-priori unknown delays and amplitudes," Proc. MILCOM'91, 1991, 
pp. 5.3.1-5.3.4. This paper describes a PSP-based interference mitigation algorithm for 
CDMA waveforms. 

[15] K. Giridhar, S. Chari, J. J. Shynk, and R. P. Gooch, "Joint 
demodulation of co-channel signals using MLSE and MAPSD algorithms," Proc. 
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ICASSP '93, Apr. 1993, vol. 4, pp. 160-163. This paper describes a technique for 
demodulation of co-channel signals. 

[16] S. N. Diggavi, B. C. Ng, and A. Paulraj, "Joint channel-data 
estimation with interference cancellation," Proc. ICC '98, Atlanta, GA, June 1998, pp. 
5 465-469. This paper describes a technique for estimating joint channels and data. 

[17] R. Raheli, A. Polydoros, and C.-K. Tzou, "Per-Survivor 
Processing: A general approach to MLSE in uncertain environments," IEEE Trans. 
Commun., vol. 43, pp. 354-364, Feb./Mar./Apr. 1995. This is the seminal paper on per- 
survivor processing. 

10 [18] G. Paparisto and K. M. Chugg, "PSP array processing for 

multipath fading channels," IEEE Trans. Commun., vol. 47, pp. 504-507, Apr. 1999. 
This paper describes PSP for ISI mitigation based on antenna array measurements. 

[19] J. Rissanen, "Modeling by shortest data description," 
Automatica, vol. 14, pp. 465-471, 1978. This paper describes minimum description 

15 length criteria. 

[20] It should be noted that adaptive detection using per-survivor 
processing is known. One approach is described in U.S. Patent No. 5,432,821 issued 
July 11, 1995 of Andreas Polydoros and Riccardo Raheli. 

[21] What is needed is an interference detection scheme which 
20 provides a more accurate model of a signal channel containing interference from 
identifiable sources. 



SUMMARY OF THE INVENTION 
[22] According to the invention, in a telecommunication system, a 

25 method for co-channel interference identification and mitigation employs adaptive 
sequence detection in connection with a model composed of a signal of interest and a 
combination other signals which constitute interference in a channel of interest, 
wherein the signal of interest is distinguished from the interference by adaptive tracking 
of signal parameters of all identifiable signals. In a particular embodiment, the process 

30 involves estimating the number and time spans of co-channel interference channels 
based on maximum likelihood estimation and minimum description length from 
training information derived from a single time division multiple access packet; and 
then applying the estimate to mitigation of co-channel interference at a receiver. Per- 
survivor-processing is one technique for adaptive sequence detection. 
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[23] The invention will be better understood by reference to the 
following detailed description in connection with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 [24] Fig. 1 is a diagram of a cellular network utilizing frequency 

reuse. 

[25] Fig. 2 is a block diagram of a receiver and channel model in 
accordance with the invention. 

[26] Fig. 3 is a block diagram of a single packet acquisition, tracking 
1 0 and joint data and channel estimator according to the invention. 

[27] Fig. 4A is a block diagram of a conventional adaptive Maximum 
Likelihood Sequence Detection (CA-MLSD) processor. 

[28] Fig. 4B is a block diagram of a per-survivor processing 
Maximum Likelihood Sequence Detection (PSP-based MLSD) processor. 
1 5 [29] Fig. 5 is a functional block diagram of a process for determining 

the estimate of the channel model and the initial estimate of corresponding model 
parameters. 

DESCRIPTION OF SPECIFIC EMBODIMENTS 

20 Signal Model and Front-end Processing 

[30] Fig. 2 is a block diagram of a receiver 200 and channel model in 
accordance with the invention. An Intended User (IU) 202 transmits a desired signal 
that is to be received by the receiver 200. The desired signal propagates along multiple 
paths 204 before reaching an antenna array 206 of the receiver 200. At the same time, 

25 Co-channel Interference (CCI) users 208 and 210 transmit CCI signals using the same 
RF frequency band as the desired signal. The CCI signals from the CCI users 208 and 
210 propagate along multiple paths 212 and 214, respectively, before reaching the 
antenna array 206. The CCI users may be from the same cell as the IU or may be from 
other cells. The antenna array 206 receives additive noise 216. Thus, the combined 

30 signal received at the antenna array 206 contains a multi-path desired signal, multi-path 
CCI signals, and additive noise from the channel. 

[31] The antenna array 206 includes individual antenna array 
elements 218. Each antenna array element 218 forwards a received signal r(t) to a 
corresponding front end (FE) processor 220. Each FE processor performs match 
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filtering functions on the r(t) signal it receives and produces a sampled receive signal 
Zk. The plurality of zt signals produced from the FE processors 220 are provided to a 
single packet acquisition, tracking and joint data and channel estimator 222. The 
estimator 222 produces n data sequence estimate 224 corresponding to data to be 
5 extracted from the desired signal by performing a joint detection technique on the 
desired signal and the CCI signals. The joint detection technique involves acquisition 
and tracking of channel parameters associated with a single packet of the desired signal 
and the CCI signals. 

[32] One embodiment of the receiver 200 and the signals shown in 

1 0 Fig. 2 is described below. Here, the CCI signals are assumed to have the same 
modulation and packet format as the desired signal from the IU. Specifically, the 
desired signal and each of the CCI signals is described as a complex baseband version 
of a digital M-ary QAM modulated signal with arbitrary pulse shaping and a slowly 
time-varying multipath channel. The antenna array 206 is assumed to have M elements 

15 218, each connected to a Fractionally-Spaced Whitened Matched Filter (FS-WMF) FE 
processor 220, matched to the shaping pulse of the IU and sampled every T s sec. The 
desired signal and the CCI signals are assumed to be narrowband signals having the 
same pulse shaping (signature). 

[33] In this embodiment, the physical channel is assumed to be a 

20 time-varying Transmission Delay Line (TDL) with minimum resolvable spacing 
between paths T c . The overall impulse response (IR) of the i a signal at the m" array 
element is: 

(Eq. 1) h (mV (c w, ';e'')= V • F w (e ; )- c (m) -'' 

where the matrix V is determined by the pulse shaping and relative delay of the i" 1 
25 signal, as well as the FE processors 220. The model in Eq. 1 encompasses a range of 
channel models from purely specular to diffuse. This is accomplished by specifying the 
array response F^(g ! ) and the joint statistics of the physical channel vectors. The 

time spans of the overall IR of channel h (M) '' is denoted by Li for all m. 

[34] The outputs of M FE processors 220 at time k, augmented in 
30 vector z t , can be expressed as 

(Eq.2) z k =f>;0hl +w k = A\0hl + f l A i ,0h' k +w t 
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The vectors contain IR vectors of M branches, h (m) '' , and the matrices A* are 

constructed from the transmitted data sequences. The "mixed inner product" (0 
operator) is an expression used extend the baud-spaced signal convolution model to a 
fractionally-spaced one. The noise w A represents the effect of independent additive 
5 white Gaussian processes at each array element 218 with power spectral level No. It 
follows that w k is a circular white Gaussian process, independent between array 

elements 218 and subsamples, with each subsample process having power No. 

[35] A compact form of Eq. 2 may be obtained by rewriting it as 

(Eq-3) z,=[Ai-Af]0 
10 where A k and h k are defined as per Eq. 3. 

Channel and CCI Identification 

[36] Fig. 3 is a block diagram of the single packet acquisition, 
tracking and joint data and channel estimator 222 according to the invention. The 

15 estimator 222 performs acquisition and tracking tasks by separately processing a 

training portion and a data portion of each received signal. A field partitioning block 
302 receives the Zk signals provided to the estimator 222 and separates each Zk signal 
into a training portion 304 and a data portion 306. 

[37] The field partitioning block 302 provides the training portions 

20 304 of the Zi< signals to a channel model and model parameter estimator 308. The 
channel model and model parameter estimator 308 also receives a set 310 of channel 
models to be tested. Using this information, the channel model and model parameter 
estimator 308 produces a channel model 312 and an initial estimate 314 of 
corresponding model parameters for the channel model. This is accomplished by 

25 testing the set 310 of channel models to determine the best model and corresponding 
model parameter estimates for the best model. 

[38] Alternatively, the channel model and model parameter estimator 
308 can internally generate the set 310 of channel models to be tested. In this 
alternative embodiment, the channel model and model parameter estimator 308 

30 receives information (not shown), such as a set of possible training sequences 



+ W t a A.Oh.+w, 
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corresponding to the desired signal from the IU and potential CCI signals from 
interferers, that enables the channel model and model parameter estimator 308 to 
generate the set of channel models to be tested. 

[39] Each channel model, such as members of the set 3 1 0 of channel 
5 models to be tested and the channel model 312, includes an estimate of the number of 
CCI signals present in the channel. Each channel model can also include an estimate of 
the time span of the Impulse Response (IR), or intersymbol interference channel 
response associated with the desired signal and each CCI signal. Furthermore, each 
channel model can include an estimate of the specific combination of training 

10 sequences in the training portion assigned for the desired signal and the CCI signals, 
assuming that the each of the desired signal and the CCI signals may be assigned a 
different training sequence. The model parameters initial estimate 314 includes an 
estimate of the coefficients of the IR, or intersymbol interference channel response, 
associated with the desired signal and each CCI signal. 

15 [40] One embodiment of the channel model and model parameter 

estimator 308 shown in Fig. 3 is described below. Here, each of the desired signal and 
CCI signals is assumed to be a time-division multiple access (TDMA) packet having a 
training sequence during a training portion. All possible training sequences, each 
consisting of N symbols, are assumed to be known at the receiver. Furthermore, the 

20 received training sequences are assumed to be synchronized between users, with the 
overall IR of the desired signal and CCI signals experience little or no change during 
the training portion. 

[41] According to this embodiment, the outputs Zk from the FE 
processors 220 corresponding to the nf (n s = 1, . . . N s ) sample of the m*" (m = 

25 1, . . . M) array element can be arranged in an (Nxl) vector which can be 

expressed as 

(Eq.4) Z W = A £ .hW + W W 

where 



(Eq. 5) A 



L 



30 
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is the (N xL) data matrix. Here, a combined time span, L , is defined as the sum of the 
time spans, Z ; - , of all modeled signals. Nj is the total number of modeled signals 
present in the channel, including the desired signal and the CCI signals. L, is the time 
span of the IR, or the intersymbol interference channel response, associated with the i* 
signal. Also, a\ is the k" data symbol of the i'" signal's training sequence, hj^ is the 

(Lxl) overall IR vector and is a zero-mean, complex Gaussian random vector 
with covariance matrix N a l NxN . Since the noise is independent between samples and 
array elements, conditioned on the overall IR vector, the probability density function 
(pdf) of the FE output vector over all samples and array elements, /(z|h) , is given by 



10 ( £ q- 6 ) TT T vw,w ex P 



N 0 



[42] The problem of determining the number of CCI signals and the 
time spans of all signals is a model selection problem, which can be stated as follows: 
Given the FE output vector and a parameterized family of pdf s given by Eq. 6, select 
the model {i.e., the parameters Nj and {Lj} ^) that best fits this output. Here, The 

1 5 present embodiment uses a Minimum Description Length (MDL) principle to select the 
model that minimizes 

(Eq. 7) MDL(jV / ,{Z ¥ }^)=-ln[^( E |hJ+^lnM 

where h is the ML estimate of h , with elements 

(Eq.8) = " A L ]~ ' A f .z£> 

20 

and p is the number of unknown parameters in the particular model. Substituting Eq. 8 
into Eq. 6 and noticing that the number of unknown parameters in the model of Eq. 4 is 
2LMN S , Eq. 7 becomes 

(Eq. 9) MDlKfeEl)- ^-ElZ^K" -4f +LMN * to M 

25 where 

(Eq- 10) P £ x = I^-A i [AfA £ [ 1 Af 
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[43] Note that the maximum likelihood (ML) estimate of the overall 
IR vector (coefficients of the intersymbol interference channel response associated with 
the desired signal and each CCI signal), which can be used for the initialization of the 
adaptive joint sequence detector 302, is obtained as a by-product of the model 
5 determination algorithm. 

Tracking and Joint Modeling 

[44] Referring again to Fig. 3, the field partitioning block 302 
provides the data portions 306 of the signals to an adaptive joint sequence detector 

10 316. The detector 316 also receives the channel model 312 and the model parameters 
initial estimate 314 from the channel model and model parameter estimator 308. From 
this information, the adaptive joint sequence detector generates the data sequence 
estimate 224 corresponding to data to be extracted from the desired signal. 

[45] At the adaptive j oint sequence detector 3 1 6, the structure of the 

15 RJ and the CCI channels are known because the channel model 312 provides an 

estimate of the number of CCI signals present and an estimate of the time span of the 
IR, or intersymbol interference channel response associated with the desired signal and 
each CCI signal. Thus, the maximum likelihood (ML) solution for the data sequences 
of the IU and the CCI could be obtained through the Viterbi Algorithm (VA). A joint 

20 trellis for the VA algorithm can be constructed, with states defined as 

[46] The branch metrics of the VA are computed as follows: 

(Eq- 12) r(«„OHK - A 4 («T t ,« t+1 )0h i | 2 

where the data matrix A k (a k , c k+l ) is constructed based on the hypothesized data 
25 symbols corresponding to the transition a k —> . The trellis size is determined by 
the time spans of all modeled signals. As defined previously, the combined time span, 
L , is the sum of the time spans, L i , of all modeled signals. The joint trellis has M L ' N ' 

states, with M N ' branches entering each state. 

[47] To carry out the VA algorithm described above, the adaptive 
30 joint sequence detector 316 may be realized in distinct implementations, including (1) a 
conventional adaptive Maximum Likelihood Sequence Detection (CA-MLSD) 
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processor and (2) a per-survivor processing (PSP) Maximum Likelihood Sequence 
Detection (PSP-based MLSD) processor. 

[48] Fig. 4A is a block diagram of CA-MLSD processor 400. The 
CA-MLSD processor 400 performs branch metric calculations according to Eq. 12, 
5 according to a single delayed decision feedback estimation adaptive sequence detection 
technique. The data portions 306 of the z k signals are input to the CA-MLSD processor 
400 and provided to a Viterbi processor 402. The Viterbi processor 402 outputs 
tentative decisions 404 having a tentative delay d to a parameter estimator 406. The 
data portions 306 of the Zk signals are also provided to a delay block 408 providing the 

10 same delay d. The delay block 408 provides its output to the parameter estimator 406. 
The parameter estimator generates a d-step outdated parameter estimate 410 back to the 
Viterbi processor 402. The Viterbi processor 402 generates an estimated data stream 
412 containing data extracted from the data portion of each of the desired signal and the 
CCI signals. Note the channel model 312 (not shown) is provided to the CA-MLSD 

15 processor 400 such that the structure of the IU and the CCI channels are known. 

[49] Fig. 4B is a block diagram of a PSP-based MLSD processor 450. 
Since the IR, or intersymbol interference channel response coefficients are time- 
varying in mobile systems, PSP-based methods can be employed to approximate the 
ML solution. In this case, the branch metric computations of Eq. 12 are modified as 

20 (Eq- 13) r(<, k ,a k J = \\z k -A k (a k ,<; k+l )<>h(c k )\f 

where h(a k ) is the estimate of the overall IR vector, , computed at step k-1, based 

on the survivor sequence corresponding to state <s k . 

[50] The PSP-based MLSD processor 450 performs branch metric 
calculations according to Eq. 13. The data portions 306 of the z k signals are input to 

25 the PSP-based MLSD processor 450 and provided to a Viterbi processor 452. The 
Viterbi processor 452 outputs a plurality of survivor sequences 454, which are zero- 
delay data estimates, to a plurality of parameter estimators 456. The data portions 306 
of the Zk signals are also input to each of the plurality of parameter estimators 456. 
Each parameter estimator 456 provides a parameter estimate back to the Viterbi 

30 processor 452. The Viterbi processor 452 generates an estimated data stream 458 
containing data extracted from the data portion of each of the desired signal and the 
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CCI signals. Note the channel model 312 (not shown) is provided to the PSP-based 
MLSD processor 450 such that the structure of the IU and the CCI channels are known. 

[51] Fig. 5 is a functional block diagram 500 of a process for 
determining the estimate 312 of the channel model and the initial estimate 314 of 
5 corresponding model parameters. The process may be implemented in the channel 
model and model parameter estimator 308. First, a model generation step 502 receives 
the set 3 10 of channel models to be tested and selects a current model from this set of 
channel models. In an alternatively embodiment, the set 310 of channel models to be 
tested can be internally generated within the model generation step 502. 
10 [52] The range of possible channel models is constructed by 

modifying one or more of the following variables: (1) Ni, the number of modeled 
signals, which includes the desired signal and all of the CCI signals (assuming there is 
always one desired signal, controlling this variable is equivalent to varying the number 
of CCI signals), (2), {L} , the time span corresponding to each of the modeled 

15 signals, and (3), {&} ^ , the training sequence in the training portion of each of the 
modeled signals. 

[53] Next, a least square (LS) error estimation step 504 generates a 
residual LS error calculation by comparing the current model with channel observations 
during the training portion of the received signal. Here, the channel observations may 
20 be the training portions 304 of the signals, discussed previously. The LS error 

estimation step also produces a current joint channel estimate, which comprises model 
parameters corresponding to the current model. In a Minimum Description Length 
(MDL) computation step 506, a current MDL value is computed according to Eq. 9 and 
Eq. 10. 

25 [54] A minimum check step 508 compares the current MDL value 

(most recently computed) against the minimum MDL value generated thus far. If the 
current MDL value is less than the minimum MDL value, the current MDL value is 
recorded as the new minimum MDL value, and a current estimate retention step 510 
records the current model and current joint channel estimate. Else, a last model check 

30 step 512 checks to see if the selected model is the last model in the range of possible 
channel models. 

[55] If the selected model is the not last model in the range of 
possible channel models, the process returns to the model generation step 502, and the 
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steps described above are repeated. If the selected model is the last model in the range 
of possible channel models, a result output step 514 outputs the model and joint 
channel estimate last recorded by the current estimate retention step 510. This output 
constitutes the estimate 312 of the channel model and the initial estimate 314 of 
corresponding model parameters. 

[56] The invention has been explained with reference to specific 
embodiments. Other embodiments will be evident to those of ordinary skill in the art. 
It is therefore not intended that this invention be limited, except as indicated by the 
appended claims. 
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